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Technical Field of the Invention 



This invention relates generally to video processing and more particularly to 

% determining video start times in stored video data. 

4- 15 

|: e Background of the Invention 

Cfi With the advent of digital video technology, many new and exciting products are 

available. One such product is a digital videocassette recorders (VCR), which receives 
20 an analog television broadcast, converts it into an MPEG ("Motion Picture Expert 

m Group") digital format and stores the MPEG video. By storing the television broadcast 

signals in a digital format, the user may view the recorded digital images in a variety of 
ways, including fast forward, rewind, pause, etc. 

25 The digital VCR allows a user to store various programs and to amass a 

substantial amount of video data. Such video data may span several hours of program 
viewing. When the user desires to watch a particular program or particular section of a 
program, the user inputs the particular start time that corresponds with the beginning of a 
program or the desired section. For example, if the user has stored programs that are 

30 broadcast via a network channel that begin at 7:00 p.m. and end at 10:00 p.m. and desires 
to watch the program that began at 8:30, the user would enter 8:30 p.m. as the start time. 



As is known, MPEG video images are time-stamped, for example every 2 
kilobytes of data. As such, when the user enters a particular start time, the time-stamps 
are used to identify the start of the corresponding data. An issue arises with MPEG video 
data in that the amount of data stored over time is not linear, i.e., it is a non-linear 
5 monotonic function. As is known, when an action scene is being recorded, substantially 
more digital information is used to represent those images than relatively stationary 
images. Thus, over time the storage of MPEG video data is a non-linear. 

AsSwith any commercial product speed in responding to user input commands are 
10 important. N the digital VCR determines the starting point of a program by scanning the 
time stamps am seeking a match, a significant amount of processing resources and time 
may be consumeOu Such processing may be noticeable to the user in a detrimental way. 
f 3 Thus, it is importankfor commercially viable digital VCRs to incorporate a technique that 

'^fi efficiently seeks the sfml of MPEG video data that is to be subsequently viewed. 

N 15 ^ 

f ifi Therefore, a need exists for a method and apparatus for successive linear 

^ approximation to obtain a specific point of a non-linear monotonic function such that fast 

B seeking of MPEG video can be realized. 

I ^ 20 Brief Description of the Drawings 

Figure 1 illustrates a schematic block diagram of a digital video recorder in 
accordance with the present invention; 

25 Figure 2 illustrates a graphical representation of MPEG video being stored in 

accordance with the present invention; 

Figure 3 illustrates a graphical representation of a non-linear monotonic function 
that may result from storing MPEG video data in accordance with the present invention; 
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Figures 4 through 6 illustrate a graphical representation of successive linear 
approximation in accordance with the present invention; and 

Figure 7 and 8 illustrate a logic diagram of a method for successive linear 
5 approximation to obtain a specific point of a non-linear monotonic function in accordance 
with the present invention. 

Detailed Description of a Preferred Embodiment 

10 Generally, the present invention provides a method and apparatus for successive 

linear approximation to obtain a specific point on a non-linear monotonic function. The 
specific point includes a T-coordinate and an N-coordinate. The method and apparatus 
include processing that begins by obtaining a T-coordinate for the specific point. The 
process then continues by selecting a minimum point and a maximum point on the non- 

15 linear monotonic fimction to bound the specific point. The processing then continues by 
deriving a linear reference between the minimum and maximum points. The process then 
proceeds by obtaining a reference N-coordinate that lies on the linear reference based on 
the T-coordinate. The process then continues by determining a reference T-coordinate 
lying on the non-linear monotonic fimction based on the reference N-coordinate. The 

20 process then continues by determining whether the reference T-coordinate is substantially 
similar to the T-coordinate. When the reference T-coordinate is not substantially similar 
to the T-coordinate, the process re-defines the minimum point or the maximum point 
based on the referenced T-coordinate. The process then repeats until the reference T- 
coordinate is substantially similar to the T-coordinate. Once the referenced T-coordinate 

25 is substantially similar to the T-coordinate, the referenced N-coordinate is determined to 
be substantially equal to the N-coordinate such that the specific point, i.e., the N and T 
coordinates are defined. With such a method and apparatus, rapid determination of a 
specific point on a non-linear monotonic fimction may be obtained. Such processing is 
readily usable in digital VCRs to determine the starting point of a user selected program. 
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The present invention can be more fully described with reference to Figures 1 
through 8. Figure 1 illustrates a schematic block diagram of a digital VCR 10 that 
includes a video capture module 12, an MPEG video encoder 14, an audio capture 
module 16, an MPEG audio encoder 18, a digital audio/video storage element 20, a 
5 digital video retrieval module 22, an MPEG video decoder 24, an MPEG audio decoder 
26, and an audio/video display 28. Note that the audio/video display 28 is not required to 
be part of the digital VCR and may be a separate element. In operation, the video capture 
module 12 receives video inputs 34 and processes them to produce digitized video data 
36. The processing of video inputs from NTSC broadcasts, VCR outputs, etc. and 
10 converting them into digitized video data 36 is known. Such a conversion is utilized in 
the All-in- Wonder product produced and manufactured by ATI Technologies. 

U The MPEG video encoder 14 receives the digitized video data 36 and encodes it 

]S into MPEG encoded video data 38. Such a video encoding process is known. In addition 

15 to processing video data, audio data is processed. An audio input 40 is received by the 
u\ audio capture module 16, which produces digitized audio data 42 therefrom. The MPEG 

audio encoder 1 8 converts the digitized audio data 42 into an MPEG encoded audio data 
f 44. 

I ^ 20 The digital audio/video storage 20 stores the MPEG encoded video data 38 and 

y3 the MPEG encoded audio data 44. The data is subsequently retrieved based on viewing 

inputs 46 received by the digital video retrieval module 22. 

The digital video retrieval module 22 includes a processing module 30 and 
25 memory 32. The processing module 30 may be a single processing device or a plurality 
of processing devices. Such a processing device may be a microcontroller, 
microcomputer, DSP, central processing unit, state machine, logic circuitry, and/or any 
device that processes signals (analog and/or digital) based on operational instructions. 
The memory may be a single memory device or a plurality of memory devices. Such a 
30 memory device may be random access memory, read-only memory, system memory, 
and/or any device that stores digital information. Note that the processing module may 



also be a central processing unit and the memory may be system memory of a personal 
computer. Further note that when the processing module implements one or more of its 
functions utilizing a state machine and/or logic circuitry, the memory storing the 
corresponding operational instructions is embedded within the circuitry comprising the 
5 state machine and/or logic circuit. 



The digital video retrieval module 22 receives the viewing inputs 46 and 
processes them to determine the corresponding audio and video data to be retrieved from 
the storage 20. The viewing inputs 46 may be the selection of a particular program that 
1 0 starts at a particular time. Having determined the starting point, the retrieval module 22 
uses a successive linear approximation scheme to obtain the starting byte of the desired 
program. The successive linear approximation scheme determines a specific point on a 
C3 non-linear monotonic function (i.e., bytes of MPEG data stored over time), which will be 

j;^ described in greater detail with reference to the remaining figures. The digital video 

„'7 1 5 retrieval module 22 provides retrieved video 48 and retrieved audio 50 to the MPEG 

m video decoder 24 and the MPEG audio decoder 26. The decoders 24 and 26 respectively 

'••1 

m produce decoded video 52 and decoded audio 54. The decoded video 52 and audio 54 

'■iz'-' ' 

" are provided to an audio/video display 28 for viewing by the user. 

Figure 2 illustrates a simple graphic diagram of an MPEG bit stream 60 that is 
=ii3 stored over trnie. The MPEG bit stream is time stamped, for example every 2 kilobytes 

of data. The ^PEG bit stream 60 will vary in length depending on the size of the storage 
20. As shown, %te 0 corresponds to time to, which is the first piece of video information 
stored and spans (wer time to encompass N bytes of video data, wherein byte n occurs at 
25 time tN. For examplte, if the storage 20 has a capability of storing 8 gigabytes of data, 

time to will correspond to the first byte of video data stored in the memory and the time tw 
will correspond to the mst byte of the 8 gigabytes of video data. 
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Figure 3 illustrates in graphic form an actual relationship of kilobytes of MPEG 
video data being stored over time. In this illustration, a linear relationship 62 of time 
versus kilobytes of video data is shown in comparison with the actual relationship 64. In 



this illustration when the slope of the actual relationship is less than the linear 
relationship, the images being stored typically correspond to an action scene. As is 
known, in action scenes, the amount of MPEG video information to represent the 
corresponding images is larger than still images. When the slope of the actual 
5 relationship 64 is greater than the slope of the linear relationship 62, the images being 
stored correspond to relatively still images where the amount of MPEG information 
required is relatively small. 

Figures 4 through 6 illustrate a graphical representation of the successive linear 
10 approximation to obtain a specific point on a non-linear monotonic function. In this 
illustration, the non-linear monotonic function 72 may represent the video data in an 
MPEG encoded stream. The unit for the horizontal axis relates to kilobytes of video data 
and the units for the vertical axis correspond to time. At time to, byte 0 is recorded and 
spans to byte n at time tn, which is the maximum amount of data that may be stored. In 
1 5 this particular example, the user has inputted a particular start time that is designated by 
ts. Having obtained the start time ts, a minimum point and a maximum point are 
determined to bound the start time ts and its corresponding program byte start (Ns). The 
minimum and maximum boundary points may be selected to be the time 0, byte 0 and 
time tn and byte Alternatively, a preliminary calculation may be determined to identify 
20 that the start time is going to be bounded with less than the absolute minimum and 

maximum values. In the example shown, the minimum point is referenced by tmin and 
Nmin. The maximum point is referenced by tmax and Nmax.- 

Having obtained the minimum and maximum points, a linear reference 70 is 
25 drawn between them. Once the linear reference is obtained, the point lying on the linear 
reference 70 corresponding to the start time ts is used to determine a byte reference Nref . 
Having obtained the byte reference N ref, a reference time t ref is determined based on the 
intersection of N ref with the non-linear monotonic function 72. 

30 Having obtained the byte reference N ref, and tref. the processing proceeds, as 

shown in Figure 5, to make a first determination as to whether the referenced point Nref 
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lies between the actual reference point and the min or max values. In this example, the 
reference point Nref lies between the actual point and the minimum point. Figure 5 
illustrates the next processing wherein tmin is reset to t ref as determined in Figure 4, The t 
ref is now set to tmin and used as the minimum where t ref and N ref are used as the new 
5 minimum reference point. Having obtained the new minimum reference point, a new 
linear reference 74 is drawn between the new minimum reference point and the 
maximum reference point. A new byte reference Nl ref is then determined based on the 
intersection of the new linear reference 74 with the program start time ts . Having 
obtained this, a new t ref is obtained by the intersection of the new byte reference Nl ref 
10 with the non-linear monotonic function. Having obtained this information, the 
processing continues as illustrated in Figure 6. 

In Figure 6, the new reference point is defined based on the new t ref being equal 
to tmin . Another new linear reference 76 is drawn between another new minimum 

1 5 reference and the maximum reference point. Having done this, another new byte 
reference N2 ref is determined based on the intersection of the another new linear 
reference 76 and the program start time Tg. Having determined this, the second new t ref 
is obtained based on the intersection of the new byte reference N2 ref and the non-linear 
monotonic function. Having obtained the second new t ref, a determination is made as to 

20 whether it is substantially similar to Tg. The values will be similar when they have the 

same time stamp, or within a few time stamps, such that the program start byte is within 2 
kilobytes of the appropriate start time. If the new t ref is not substantially equal to the 
program start time, the processing as shown in Figures 4-6 is continued until it is. 

25 Figures 7 and 8 illustrate a logic diagram of a method for successive linear 

approximation to obtain a specific point of a non-linear monotonic function. The 
processing steps of Figure 7 and 8 may be stored in memory 32 and executed by 
processing module 30 of the digital video retrieval module 22. The process begins at step 
80 where a t-coordinate of a specific point is obtained. The t-coordinate may comprise a 

30 time stamp value that is associated with a beginning of a video program stored in a video 
file. The specific point would also include an n- coordinate, which would comprise a 



byte count value associated with the beginning of the video program. Such a video 
program, or video file, may be stored as MPEG video data and MPEG audio data. 

The process then proceeds to step 82 where a minimum n- coordinate and a 
maximum n-coordinate are selected to bound the n-coordinate of the specific point. The 
process then proceeds to step 84 where a minimxmi t-coordinate is obtained from the 
minimum n-coordinate based on the intersection of the minimum n-coordinate and the 
non-linear monotonic function. The process then proceeds to step 86 where a maximum 
t- coordinate is obtained from the intersection of the maximum n-coordinate with the 
non-linear monotonic function. 

The process then proceeds to step 88 where a linear reference is derived between 
the minimum n- and t-coordinates and the maximum n- and t-coordinates. The step then 
proceeds to step 90 where a reference n-coordinate is obtained based on the intersection 
of the t-coordinate and the linear reference. The process then proceeds to step 92 where a 
reference t-coordinate that lies on the non-linear monotonic functions is determined based 
on the intersection of the reference n-coordinate and the non-linear monotonic function. 
The process then proceeds to step 94 where a determination is made as to the reference t- 
coordinate is substantially similar to the t-coordinate. If so, the process proceeds to step 
96 where the reference n-coordinate is determined to be substantially equal to the n- 
coordinate. Having done this, the specific point on the non-linear monotonic function is 
determined. 

If, however, the referenced t-coordinate is not substantially similar to the t- 
coordinate, the process proceeds to step 98. At step 98 a determination is made as to 
whether the reference t-coordinate is greater than the t-coordinate. If so, the process 
proceeds to step 100 where the maximum t-coordinate is redefined to equal the reference 
t-coordinate. The process then proceeds to step 102 where a new maximum n-coordinate 
that lies on the non-linear monotonic function is determined based on the new maximum 
t-coordinate intersecting with the non-linear monotonic function. The process then 
proceeds to step 104 where a new maximum t-coordinate intersecting v^th the non-linear 
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monotonic function. The process then proceeds to step 104 where a new Unear reference 
is derived between the minimum n- and t-coordinates and the new maximum n-and t- 
coordinates. The process then continues at step 106 of Figure 8 where a new reference n- 
coordinate that lies on the new linear reference is obtained based on the t-coordinate 
5 intersecting the new linear reference. The process then proceeds to step 108 where a new 
reference t-coordinate that lies on the non-linear monotonic function is determined based 
on the intersection of the new reference n-coordinate and the non-linear monotonic 
function. Having done this the process reverts to step 94 of Figure 7. 

10 If at step 98 it was determined that the reference t-coordinate is not greater than 

the t-coordinate the process proceeds to step 1 10 of Figure 8. At step 1 10 the minimum t- 
coordinate is redefined to equal the referenced t- coordinate. The process then proceeds 

0 to step 1 12 where a new minimum n-coordinate that lies on the non-linear monotonic 
^ function is determined based on the intersection of the new minimum t-coordinate and 

15 the non-linear monotonic function. The process then proceeds to step 1 14 where a new 
%M linear reference is derived between the new minimum n- and t-coordinates and the 

maximum n- and t-coordinates. The process then proceeds to step 116 where a new 
reference n-coordinate that lies on the new linear reference is obtained based on the 
m intersection of the t-coordinate and the new linear reference. The process then proceeds 

1 ^ 20 to step 118 where a new reference t-coordinate that lies on the non-linear monotonic 

^3 function is determined based on the intersection of the new referenced n-coordinate and 

the non-linear monotonic function. 

The preceding discussion has presented a method and apparatus for a successive 
25 linear approximation to obtain a specific point of a non-linear monotonic function. Such 
a method and apparatus will be useful in a digital VCR to determine a starting point in a 
selected program for viewing. As one of average skill in the art will appreciate other 
embodiments may be derived from the teachings of the present invention without 
deviating the scope of the claims. 



